Integrating Stereo and Shape from Shading
نویسندگان
چکیده
This paper presents a new method for integrating di erent low level vision modules, stereo and shape from shading, in order to improve the 3D reconstruction of visible surfaces of objects from intensity images. The integration process is based on correcting the 3D visible surface obtained from shape from shading using the sparse depth measurements from the stereo module by tting a surface into the di erence between the two data sets. A feedforward neural network is used to t a surface to the error di erence. An extended Kalman lter algorithm is used for the network learning. It is found that the integration of sparse depth measurements has greatly enhanced the 3D visible surface obtained from shape from shading in terms of metric measurements.
منابع مشابه
Combining Shape from Shading and Stereo Using Human Vision Model Combining Shape from Shading and Stereo Using Human Vision Model
Stereo algorithms suuer from the lack of local surface texture due to smoothness of depth constraint , or local miss-matches in disparity estimates. Thus, the stereo methods only provide a coarse depth map which can be associated with a low pass image of the depth map. On the other hand, shape from shading algorithms produce better estimates of local surface areas, but some of them have problem...
متن کاملIntegrating Stereo with Shape-from-Shading derived Orientation Information
Binocular stereo has been extensively studied for extracting the shape of a scene. The challenge is in matching features between two images of a scene; this is the correspondence problem. Shape from shading (SfS) is another method of extracting shape. This models the interaction of light with the scene surface(s) for a single image. These two methods are very different; stereo uses surface feat...
متن کاملIntegration of shape from shading and stereo
-Stereo algorithms suffer from the lack of local surface texture due to smoothness of depth constraint, or local miss-matches in disparity estimates. Thus, most stereo methods only provide a coarse depth map which can be associated with a low pass image of the depth map. On the other hand, shape from shading algorithms generally produce better estimates of local surface areas, but some of them ...
متن کاملStereoscopic Shading: Integrating Multi-frame Shape Cues in a Variational Framework
We address the problem of integrating multi-frame stereo and shading cues within the framework of optimization in the in nite-dimensional space of piecewise smooth surfaces. Cue integration then reduces to the determination of regions where prior assumptions on the re ectance of the surfaces can be enforced. By combining cues, our formulation allows de ning a well-posed problem even when recons...
متن کاملStereoscopic Shading: Integrating Mult1Frame Shape Cues in a Variational Framework
We address the problem of integrating multi-frame stereo and shading cues within the framework of optimization in the infinite-dimensional space of piecewise smooth surfaces. Cue integration then reduces to the determination of regions where prior assumptions on the reflectance of the surfaces can be enforced. By combining cues, our formulation allows defining a well-posed problem even when rec...
متن کامل